Systems and methods to modify playout or playback

ABSTRACT

Systems and methods to modify playout/playback include responding to a trick mode request (e.g., fast forward, rewind). First, a transmission is received at a receiving device. The transmission includes primary content and a secondary information identifier and is stored on a storage device. Next, primary content is rendered to an output device at the receiving device at a normal speed for the primary content. Next, a request is received to render the primary content to an output device at the receiving device at an accelerated speed of the primary content. Next, the primary content is associated to secondary derivative content based on the secondary information identifier. Finally, the secondary derivative content is rendered instead of the primary content, to the output device at the receiving device at a normal speed for the secondary derivative content.

RELATED APPLICATIONS

This application is a Divisional of U.S. application Ser. No.11/469,195, filed on Aug. 31, 2006, which is incorporated herein byreference in its entirety.

FIELD

Embodiments relate generally to the technical field of communicationsand more specifically to systems and methods to modify playout orplayback of primary content.

BACKGROUND

Many receiving devices such as personal video recorders (PVRs) ordigital video recorders (DVRs) may provide support for trick moderequests that enable a user to fast forward or rewind content (e.g.primary content). For example, a user who has recorded a movie on a PVRmay fast forward through a scene while playing the movie. In response tothe request, the PVR may render the movie to a display device at anaccelerated speed. Two disadvantages may be identified in processing theusers request to fast forward. First, the content played out in responseto the fast forward request is the same content, nevertheless played atan accelerated speed. Second, the content played out in response to thefast forward request may appear jerky and reproduce poorly makingidentification of scenes difficult.

BRIEF DESCRIPTION OF DRAWINGS

Embodiments are illustrated by way of example and not limitation in thefigures of the accompanying drawings, in which like references indicatesimilar elements and in which:

FIG. 1 is a block diagram illustrating a system, according to an exampleembodiment, to modify playout of primary content;

FIG. 2 is a block diagram illustrating a database, according to anexample embodiment;

FIG. 3 is a block diagram illustrating example embodiments ofentertainment secondary information, according to an example embodiment;

FIG. 4 is a block diagram illustrating example embodiments ofadvertisement secondary information;

FIG. 5 is a block diagram illustrating frames and packets, according toan example embodiment;

FIG. 6 is a flowchart illustrating a method, according to an exampleembodiment;

FIG. 7 is a flowchart illustrating a method, according to an exampleembodiment, to identify secondary information based on a trick moderequest;

FIG. 8 is a flowchart illustrating a method, according to an exampleembodiment;

FIG. 9 is a block diagram illustrating a system, according to an exampleembodiment, to modify simulated primary content at a receiving device;

FIG. 10 is a block diagram illustrating a database, according to anexample embodiment;

FIG. 11 is a flow chart illustrating a method, according to an exampleembodiment, to modify simulated primary content at a receiving device;

FIG. 12 is a block diagram illustrating a system, according to anexample embodiment;

FIG. 13 is a block diagram illustrating a database, according to anexample embodiment;

FIG. 14 is a block diagram illustrating a database, according to anexample embodiment;

FIG. 15 is a block diagram illustrating a receiving device, according toan example embodiment;

FIG. 16A is a block diagram illustrating a component transmission,according to an example embodiment;

FIG. 16B is a block diagram illustrating a component transmission,according to an example embodiment;

FIG. 16C is a block diagram illustrating a component transmission,according to an example embodiment;

FIG. 16D is a block diagram illustrating a transmission, according to anexample embodiment;

FIG. 17 is a block diagram illustrating streams associated with achannel, according to an example embodiment;

FIG. 18 is a block diagram illustrating the packet, according to anexample embodiment;

FIG. 19 is a block diagram illustrating a secondary information table,according to an example embodiment;

FIG. 20 is a block diagram illustrating primary content and secondaryinformation communicated in the video stream and the audio stream of asingle channel, according to an example embodiment;

FIG. 21 is a block diagram illustrating primary content communicated ina first channel and secondary information communicated in a secondchannel, according to an example embodiment;

FIG. 22 is a block diagram illustrating the primary content communicatedin a video stream and an audio stream of a channel and the secondaryinformation communicated in the metadata stream of the same channel,according to an example embodiment;

FIG. 23 is a block diagram illustrating end of primary content markers,according to an example embodiment;

FIG. 24 is flowchart illustrating a method, according to an exampleembodiment, to modify playback of primary content at a receiving device;

FIG. 25 is a flow chart illustrating a method, according to an exampleembodiment, to communicate a transmission that facilitates modificationof playback of primary content at a receiving device;

FIG. 26 is a diagram illustrating a user interface, according to anexample embodiment;

FIG. 27 is a block diagram of a machine, according to an exampleembodiment, including instructions to perform any one or more of themethodologies described herein.

DETAILED DESCRIPTION

In the following description, for purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of example embodiments of the present invention. It willbe evident, however, to one skilled in the art that the presentinvention may be practiced without these specific details.

Embodiments described below use one of two approaches to respond to atrick mode request (e.g., fast forward, rewind, skip request). First, atrick mode request may be responded to by associating primary content tosecondary content and playing out the secondary content on a receivingdevice, the secondary content not being derived from the primarycontent. For example, a user viewing a movie (e.g., primary content) mayselect a fast forward button that causes fast forwarding of the movie;however, instead of viewing the movie at an accelerated speed, the usermay view and/or hear secondary content. Taking this approach, the authorof the secondary content is empowered with complete editorial controlover the secondary content. Accordingly, the author may create secondarycontent of the same subject matter as the primary content or createsecondary content of a different subject matter altogether. Further, theauthor may create secondary content of the same medium (e.g., audioand/or video) and presentation (e.g., full motion and/or slide show) ofthe primary content or create secondary content of a different medium(e.g., audio and/or video) and presentation (e.g., full motion and/orslide show). In addition, the author of the primary content need not bethe author of the secondary content or be legally or otherwise relatedto the author of the secondary content.

Second, a trick mode request may be responded to by associating primarycontent to secondary content and playing out the secondary content on areceiving device, the secondary content being derived from the primarycontent but played at a normal speed for the secondary content. Takingthis approach, the author of the secondary content is empowered withlimited editorial control over the secondary content because thesecondary content is derived from the primary content. For example, thederivative secondary content may include selected samples (e.g., audioand/or visual; motion and/or slide show) from the associated primarycontent. Further, the secondary content may be played at a normal speedfor the secondary content thereby eliminating the jerkiness and poorreproduction normally associated with rendering primary content that isfast forwarded or rewound.

DEFINITIONS

Primary Content in this document is intended to include content that maybe played on a receiving device or interacted with on a receivingdevice. Primary content may include but is not limited to entertainmentcontent and advertisement content. Further, primary content may includevideo content and/or audio content and/or associated metadata.

Secondary Content in this document is intended to include content thatmay be substituted for primary content responsive to receipt of a trickmode request (e.g., fast forward, rewind, reverse, etc.). The secondarycontent may be played or interacted with on a receiving device. Further,secondary content may include video content and/or audio content and/orassociated metadata.

Secondary Information in this document may include secondary content,information to generate secondary content or information to accesssecondary content.

Derivative Secondary Content in this document is intended to includesecondary content that is generated from the associated primary content.For example, derivative secondary content may include samples (e.g.,audio and/or visual) from the associated primary content.

Non-Derivative Secondary Content in this document is intended to includesecondary content that is not generated from the associated primarycontent. For example, derivative secondary content does not includesamples (e.g., audio and/or visual) from the associated primary content.

Normal Speed in this document is intended to include an instantaneousspeed to render a discrete unit of content (e.g., primary content orsecondary content) to an output device, the normal speed being the speednecessary to completely render the discrete unit of content frombeginning to end in a predetermined play time that is associated withthe content. For example, an episode of Gilligan's Island may berendered at a receiving device at a normal speed such that the episodecompletes in a predetermined running time (e.g., play time) oftwenty-five minutes. Play times may be published with the primary andsecondary content. For example, movies may be stored on media andlabeled with the play time of the movie. A normal speed may beapplicable to advancing the discrete unit of content in forward orreverse directions.

Accelerated Speed in this document is intended to include aninstantaneous speed to render a discrete unit of content to an outputdevice, the accelerated speed being any speed greater than the normalspeed associated with the discrete unit of content. An accelerated speedmay be applicable to advancing the discrete unit of content in forwardor reverse directions.

Point to Point Communications

This section describes aspects of the present disclosure that may beembodied using point to point communications. For example, point topoint communications may be embodied as a receiving device that requestsa video on demand asset from a video on demand server.

According to a first example aspect of the present disclosure a requestfor primary content may be received at a system. In response, the systemmay communicate the primary content to a receiving device that mayrender the primary content to an output device at a normal speed of theprimary content. Also, in response, the system may associate primarycontent to secondary information that is communicated to a receivingdevice. Next, the receiving device may receive a request to render theprimary content at the receiving device at an accelerated speed of theprimary content (e.g., fast forward, rewind). In response, the receivingdevice may use the secondary information to render secondarynon-derivative content to the output device instead of the primarycontent.

According to a second example aspect of the present disclosureprocessing is substantially similar as the first example aspect of thepresent disclosure except the secondary information may be used torender secondary derivative content instead of secondary non-derivatederivative content. Further, the receiving device may render thesecondary derivative content at a normal speed for the secondarynon-derivative content. For example, the secondary non-derivativecontent may include a full motion recording of selected scenes from theprimary content.

Other embodiments of the first and second aspects may include theprimary content being stored to a storage device at the receiving devicebefore rendering to the output device, the secondary content beingalready generated at the time of the trick mode request, and thesecondary content to be generated at the time of the trick mode request.

According to a third example aspect of the present disclosure a systemreceives a request for primary content. In response to the request, thesystem may communicate the primary content to a receiving device thatrenders the primary content to an output device at a normal speed of theprimary content. Next, the system may receive a request from thereceiving device to communicate the primary content for rendering at theoutput device at the receiving device at an accelerated speed of theprimary content (e.g., fast forward, rewind). In response, the systemmay associate the primary content to secondary non-derivative contentand communicate the secondary non-derivative content to the receivingdevice. Next, the receiving device may render the secondarynon-derivative content to the output device.

According to a fourth example aspect of the present disclosureprocessing is substantially similar as the third example aspect of thepresent disclosure except the secondary derivative content may beutilized instead of secondary non-derivate derivative content. Further,the receiving device may render the secondary derivative content at anormal speed for the secondary derivative content.

Other embodiments of the third and fourth aspects may include theprimary content being stored to a storage device at the receiving devicebefore rendering to the output device, the secondary content beingalready generated at the time of the trick mode request, and thesecondary content to be generated at the time of the trick mode request.

According to a fourth example aspect of the present disclosure areceiving device may receive a request for primary content. In response,the receiving device may render the primary content to an output deviceat the receiving device at a normal speed for the primary content. Next,the receiving device may receive a request to render the primary contentto the output device at an accelerated speed for the primary content(e.g., fast forward, rewind). Next, the receiving device may receive asimulated primary content at the receiving device for render to theoutput device at the receiving device so as to simulate render of theprimary content to the output device at the receiving device at anaccelerated speed (e.g., fast forward, rewind). Next, the receivingdevice may generate secondary derivative content based on the simulatedprimary content. Finally, the receiving device may render the secondaryderivative content to the output device instead of the simulated primarycontent. Further, the receiving device may render the secondaryderivative content at a normal speed for the secondary derivativecontent.

Point to Multi-Point Communications

This section describes aspects of the present disclosure that may beembodied using point to multi-point communications. For example, pointto multi-point communications may be embodied using an insertion systemthat transmits an Internet Protocol (IP) transport streams in MovingPicture Experts Group-two (MPEG-2) compression formats to multiplereceiving devices (e.g., settop boxes).

According to a fifth example aspect of the present disclosure areceiving device receives a transmission that includes primary contentand a secondary information identifier. The receiving device stores thetransmission on a local storage device (e.g. Pause). Next, the receivingdevice may retrieve the transmission from the local storage device torender the primary content to an output device at the receiving deviceat a normal speed for the primary content (e.g., Play). Next, thereceiving device may receive a request to render the primary content toan output device at the receiving device at an accelerated speed of theprimary content (e.g., Fast forward, rewind). Next, the receiving devicemay associate the primary content to secondary non-derivative contentbased on the secondary information identifier. Finally, the receivingdevice may render the secondary non-derivative content to the receivingdevice.

According to a sixth example aspect of the present disclosure processingis substantially similar as the fifth example aspect of the presentdisclosure except the secondary derivative content may be utilizedinstead of secondary non-derivate derivative content. Further, thereceiving device may render the secondary derivative content at a normalspeed for the secondary non-derivative content.

Other embodiments of the fifth and sixth aspects may include thesecondary content being already generated at the time of the trick moderequest, the secondary content being generated responsive to the trickmode request, and the secondary content being retrieved from remotestorage rather than local storage.

According to a seventh example aspect of the present disclosures asystem generates a transmission that includes primary content and asecondary information identifier. Next, the system communicates thetransmission to a receiving device that may process the transmissionaccording the fifth aspect described above.

According to an eight example aspect of the present disclosures a systemgenerates a transmission that includes primary content and a secondaryinformation identifier. Next, the system communicates the transmissionto a receiving device that may process the transmission according thesixth aspect described above.

FIG. 1 is a block diagram illustrating a system 10, according to anexample embodiment. The system 10 is shown to include a receiving device12, a video on demand system 14, and a network 16. The receiving device12 may, for example, include a set top box (STB), a personal computer,an iPod, a personal video recorder (PVR) (e.g., analog or digitalinput), a personal digital recorder (PDR) (e.g., analog or digitalinput), a mobile phone, a portable media player, a game console or anyother device capable of playing video and/or audio content. Thereceiving device 12 is shown to be coupled to an output device 18 and adatabase 22. In an example embodiment, the receiving device 12 may beoperated or controlled with control buttons 19 or a remote control 20.The output device 18 may include a sound device 24 and a display device26, however, it will be appreciated by those skilled in the art that theoutput device 18 may also include a machine device to communicatemachine interface information (e.g., SGML) to a machine (e.g., client,server, peer to peer). The network 16 may be any network capable ofcommunicating video and/or audio and may include the Internet, closed IPnetworks such as DSL or FTTH, digital broadcast satellite, cable,digital, terrestrial, analog and digital (satellite) radio, etc. and/orhybrid solutions combining one or more networking technologies.

The video on demand system 14 is shown to include a streaming server 28a live feed 29, and a database 30. The database 30 that may be a sourceof prerecorded primary content 32 and secondary information 34 and thelive feed 29 may be a source of live primary content 32 and livesecondary information 34. The primary content 32 may be played on theoutput device 18 at the receiving device 12. The secondary information34 may include entertainment secondary information and advertisementsecondary information. The secondary information 34 may further includesecondary content 35 that also may be played on the output device 18 atthe receiving device 12. Other embodiments may include secondaryinformation 34 that may be used to generate secondary content 35, asdescribed further below.

The streaming server 28 includes a request module 36 and a communicationmodule 38. The request module 36 may receive requests from the receivingdevice 12. For example, the request module 36 may receive a request toplay primary content 32, a request to fast forward primary content 32, arequest to rewind primary content 32, and a request to pause primarycontent 32. In one example embodiment, the streaming server 28 and thereceiving device 12 may utilize the real time streaming protocol (RTSP)to communicate. In another example embodiment the streaming server 28and the receiving device 12 may utilize the digital storage mediacommand and control protocol (DSM-CC) to communicate.

The communication module 38 may respond to requests received by thereceiving module 218. For example, the communication module 38 mayrespond by communicating primary content 32 to the receiving device 12,communicating a secondary information identifier to the receiving device12, or communicating secondary content 35 to the receiving device 12.

While the system 10 shown in FIG. 1 employs a client-serverarchitecture, the present disclosure is of course not limited to such anarchitecture, and could equally well find application in a distributed,or peer-to-peer, architecture system. The request module 36 andcommunication module 38 may also be implemented as standalone softwareprograms, which do not necessarily have networking capabilities.

FIG. 2 is a block diagram illustrating a database 30, according to anexample embodiment. The database 30 is shown to include an entertainmentasset table 40, and advertisement asset table 42, an entertainmentsecondary information table 48, and an advertisement secondaryinformation table 50. The entertainment asset table 40 includes primarycontent 32 in the form of entertainment assets 44 (e.g., video on demandassets). The entertainment asset 44 may be embodied as an audio/videoasset such as a movie, television program such as a documentary, abiography, a cartoon, a program, music, or music video or an audio assetsuch as music track, audio interview or news program or any other formof entertainment that may be requested from the receiving device 12. Aparticular entertainment asset 44 may be accessed in the entertainmentasset table 40 with an entertainment asset identifier.

The advertisement asset table 42 includes primary content 32 in the formof advertisement assets 46 (e.g., video on demand assets). For example,the advertisement asset 46 may be embodied as a commercial, a publicservice announcement, an infomercial or any other form of advertisement.A particular advertisement asset 46 may be accessed in the advertisementasset table 42 with an advertisement asset identifier.

The entertainment secondary information table 48 includes secondaryinformation 34 that includes secondary content 35 that may be embodiedas an entertainment recording 52. For example, the entertainmentrecording 52 may include key scenes from a movie that may be presentedin full motion with sound thereby enabling the user to easily identifywhere the user wishes to resume play. The entertainment secondaryinformation table 48 may include multiple entertainment recordings 52that respectively correspond to entertainment assets 44 in theentertainment asset table 40. Accordingly, a specific entertainmentasset 44 may be associated to a corresponding secondary information 34(e.g., entertainment recording 52) in the entertainment secondaryinformation table 48.

The advertisement secondary information table 50 includes secondaryinformation 34 in the form of secondary content 35 the may be embodiedas an advertisement recording 54. For example, the advertisementrecording 54 may include an abbreviated form of the full lengthadvertisement asset 46. The advertisement secondary information table 50may include multiple advertisement recordings 54 that respectivelycorrespond to advertisement assets 46 in the advertisement asset table42. Accordingly, a specific advertisement asset 46 may be associated toa corresponding secondary information 34 (e.g., advertisement recording54) in the advertisement secondary information table 50.

The entertainment recordings 52 and the advertisement recordings 54 arerespectively shown to include six versions that correspond to types oftrick mode requests to fast forward or reverse (e.g., rewind) primarycontent 32. Further the trick mode may specify an accelerated speed tofast forward or rewind the primary content 32. For example, the requestto fast forward or rewind may be twice-times (e.g., 2×), four-times(e.g., 4×) and six-times (e.g., 6×) of the normal speed at which theprimary content 32 is rendered to the output device 18. Other exampleembodiments may include additional or fewer versions.

The various versions may correspond to secondary content 35 that hasplay times of different duration. For example, secondary content 35corresponding to twice-times (e.g., 2×), a four-times (e.g., 4×), andsix-times (e.g., 6×) may have play times of 10, 5, and 2 seconds,respectively. Further, it will be appreciated by a person havingordinary skill in the art that the above described secondary content 35may be designed to be played at normal speed or at any speed within arange of speeds around the normal speed (e.g., accelerated speeds) toachieve a high quality play out.

In some embodiments, the primary content 32 and secondary content 35 maybe accompanied with an interactive application that may result in apresentation to an end user that enables interaction with the user. Forexample, an entertainment asset 44 in the form of an episode of“American Idol” may include an interactive application that may cause apop-up that enables an end user to cast a vote. The episode of “AmericanIdol” may further be interleaved with advertisements assets 46 that mayenable the voting to continue while the advertisement asset 46 isplaying. Further, the entertainment asset 44 and the advertisementrecording 54 may be respectively associated with secondary content 35(e.g., an entertainment recording 52 and an advertisement recording 54)that may also include interactive applications that may also result in apresentation to an end user that has an interactive quality. Forexample, an entertainment recording 52 associated with the episode of“American Idol” may include an interactive application that causes apop-up that presents a current tally of the previously described vote.

FIG. 3 is a block diagram illustrating example embodiments ofentertainment secondary information 37. The entertainment secondaryinformation 37 may include secondary content 35, secondary metadata 58or a secondary application 60.

The secondary content 56 may be immediately rendered by the receivingdevice 12 to the output device 18 and may be embodied as the previouslydescribed entertainment recording 52 or an entertainment slide show 62.The entertainment slide show 62 may include one or more still images andsound that be rendered to the output device 18 at the receiving device12. The still images may have video effects applied to them, includingbut not limited to fade-ins and fade-outs dissolves, splits, wipes, etc.

The secondary content 35 may include derivative secondary content andnon-derivative secondary content. For example, the derivative secondarycontent may include samples (e.g., audio and/or visual) from theassociated primary content. In contrast, the non-derivative secondarycontent does not include samples (e.g., audio and/or visual) from theassociated primary content.

The secondary metadata 58 may be utilized to generate secondary content35 (e.g., an entertainment recording 52 or an entertainment slide show62). The secondary metadata 58 may be embodied as entertainmentrecording metadata 64 and an entertainment slide show metadata 66. Theentertainment recording metadata 64 may be utilized by the communicationmodule 38 or the receiving device 12 to generate the entertainmentrecording 52. In addition, the entertainment slide show metadata 66 maybe utilized by the communication module 38 or the receiving device 12 togenerate the entertainment slide show 62. For example, the communicationmodule 38 or the receiving device 12 may utilize the metadata 72, 74 toidentify and collect samples (e.g., audio, visual) from the associatedprimary content 32.

The secondary application 60 may be an application that may be executedby the communication module 38 or the receiving device 12 to generatesecondary content 56. For example, the secondary application 60 mayinclude an entertainment application 68 that may be executed bycommunication module 38 or the receiving device 12 to generate anentertainment recording 52 or an entertainment slide show 62.

The secondary content 35, secondary metadata 58, and the secondaryapplication 60 may be prerecorded and stored on the database 30.Further, the secondary content 35 may be live (e.g., sporting events,election results, etc.) and communicated to the streaming server 28 fromthe live feed 29. Accordingly, the secondary information 34 receivedfrom the live feed 302 may include an entertainment recording 52 (e.g.live content), an entertainment slide show 62 (e.g. live content), anadvertisement recording 54 (e.g. live content), and an advertisementslide show (e.g. live content).

FIG. 4 is a block diagram illustrating example embodiments ofadvertisement secondary information 39. The advertisement secondaryinformation 39 may include secondary content 35, secondary metadata 58,or a secondary application 60.

The secondary content 56 may be immediately rendered by the receivingdevice 12 to the output device 18. The secondary content 56 may beembodied as the previously described advertisement recording 54 or anadvertisement slide show 70. The advertisement slide show 70 may includeone or more still images and sound that may be rendered to the outputdevice 18 at the receiving device 12. The still images may have videoeffects applied to them, including but not limited to fade-ins andfade-outs dissolves, splits, wipes, etc.

The secondary content 35 may include derivative secondary content andnon-derivative secondary content. For example, derivative secondarycontent may include samples (e.g., audio and/or visual) from theassociated primary content. In contrast, non-derivative secondarycontent does not include samples (e.g., audio and/or visual) from theassociated primary content 32.

The secondary metadata 58 may be utilized to generate secondary content35 (e.g., advertisement recording 54 or an advertisement slide show 70).The secondary metadata 58 may be embodied as advertisement recordingmetadata 72 and an advertisement slide show metadata 66. Theadvertisement recording metadata 72 may be utilized by the communicationmodule 38 or the receiving device 12 to generate secondary content 35 inthe form of the advertisement recording 54. In addition, theadvertisement slide show metadata 74 may be utilized by thecommunication module 38 or the receiving device 12 to generate secondarycontent 35 in the form of the advertisement slide show 70. For example,the communication module 38 or the receiving device 12 may utilize themetadata 72, 74 to identify and collect samples (e.g., audio, visual)from the associated primary content 32.

The secondary application 60 may be executed by the communication module38 or the receiving device 12 to generate secondary content 56. Forexample, the secondary application 60 may include an advertisementapplication 68 that may be executed by communication module 38 or thereceiving device 12 to generate an advertisement recording 54 or anadvertisement slide show 70.

FIG. 5 is a block diagram illustrating frames 80 and packets 82according to an example embodiment. In an example embodiment the primarycontent 32 and the secondary information 34 may be stored as frames 80on the database 30. In another example embodiment the primary content 32and the secondary information 34 may be stored as packets 82 on thedatabase 30.

Moving from left to right, analog image data and analog sound data maybe encoded by an encoder to produce the frames 80. The frames 80 includereference frames 86, reference frame changes 84, and a metadata frame87. The reference frame 86 may contain reference frame data that issufficient to completely render an image on the display device 26. Incontrast, the reference frame change 84 may contain reference framechange data representing the differences between two successive frames80. The reference frame change 84 thereby enables bandwidth savingsproportional to the similarity between the successive frames 80 (e.g.,redundant information is not communicated). The metadata frame 87contains metadata frame data that may be used to synchronize thecorresponding image and sound data.

The reference frames 86, reference frame changes 84, and metadata frames87 may further be packetized by a multiplexer into packets 82. Thepackets 82 are shown to include video information, audio information andmetadata.

FIG. 6 is a flowchart illustrating a method 100, according to an exampleembodiment. Illustrated on the right are operations performed on thereceiving device 12 and illustrated on the left are operations performedon the streaming server 28. The method 100 commences at the receivingdevice 12, at operation 102, with the user requesting an entertainmentasset 44. For example, the user may use a remote control 20 to select avideo on demand asset from a menu that is displayed on the displaydevice 26. In response to the user's request, the receiving device 12may communicate the request over the network 16 to the streaming server28. In an example embodiment the receiving device 12 and the streamingserver may utilize the real time streaming protocol (RTSP).

At operation 104, at the streaming server 28, the request module 36receives the request to play the video on demand asset. For example, therequest may include a primary content identifier that may be used toaccess the appropriate entry in the entertainment asset table 40. Atoperation 106, the communication module 38 communicates (e.g., streams,playout) the entertainment asset 44 over the network 16 to the receivingdevice 12.

At operation 108 the receiving device 12 receives and renders theentertainment asset 44 to the display device 26 at the normal speed forthe entertainment asset 44 until a scheduled advertisement.

At operation 110, at the streaming server 28, the communication module38 communicates primary content 32 embodied as an advertisement asset46.

At operation 112, the receiving device 12 receives and renders theadvertisement asset 46 at normal speed on the display device 26 and thesound device 24. At operation 114, the user may decide not to watch theadvertisement and select the fast forward button on the remote control20 to accelerate the forward speed of the advertisement. Responsive tothe request, the receiving device 12 may communicate the fast forwardtrick mode request to the streaming server 28. For example, the user mayrequest fast forwarding at twice the normal speed (e.g., 2×FF) of theadvertisement asset 46 by pressing a fast forward button on the remotecontrol 20 once.

At operation 116, at the streaming server 28, the request module 36receives the trick mode request from the receiving device 12. Forexample, the trick mode request may include a primary contentidentifier, a direction identifier (e.g., forward or reverse) and aspeed identifier (e.g., 2×, 4×, 6×, etc.).

At operation 118, the communication module 38 associates primary content32 to secondary content 35 in the form of the advertisement asset 46 tothe corresponding secondary content 35 in the form of an advertisementrecording 54 responsive to the request. For example, the communicationmodule 38 may associate the advertisement asset 46 to a version that istwice the normal speed (e.g., 2×FF) of the advertisement recording 54.In addition, the communication module 38 may initiate fast forwarding ofthe advertisement asset 46 at twice the normal speed without streamingthe advertisement asset 46 to the receiving device 12. At operation 120,the communication module 38 may communicate (e.g., playout, stream,etc.) secondary content 35 embodied as the advertisement recording 54 tothe receiving device 12.

At operation 122, the receiving device 12 may receive and render theadvertisement recording 54 (e.g., derivative secondary content) atnormal speed to the output device 18 until the advertisement recording54 ends at operation 124. At operation 126 the user requests the playmode by pressing the play button on the remote control 20 and thereceiving device 12 communicates the request to the streaming server 28.

At operation 128, at the streaming server 28, the request module 36receives the request and at operation 130 the communication module 38communicates the entertainment asset 44 to the receiving device 12.

At operation 132 the receiving device 12 receives and renders theentertainment asset 44 to the display device 26 and the sound device 24at a normal speed for the advertisement asset 44.

Other Examples Offsets into Primary and Secondary Content

The user in the above example entered a fast forward trick mode requestat the beginning of a discrete unit of primary content 32 (e.g.,advertisement asset 46) and the communication module 38 responded bycausing the rendering of a discrete unit of secondary content 35 (e.g.,advertisement recording 54) from the beginning of the discrete unit ofsecondary content 35 (e.g., advertisement recording 54). It will beappreciated by one skilled in the art that other examples may includethe user entering a fast forward trick mode request at some offset intothe primary content 32 and the communication module 38 responding byadvancing to a corresponding offset from the beginning of the secondarycontent 35 (e.g., associated advertisement recording 54) and commencingthe rendering of the secondary content 35 (e.g., advertisement recording54) from the identified offset. For example, a user that enters a fastforward trick mode request in the middle of an advertisement asset 46may cause the communication module 38 to begin rendering the associatedadvertisement recording 54 in the middle of the advertisement recording54. In general, the author of the secondary content 35 may exercisecomplete editorial control over selection of the offset into thesecondary content 35 from which rendering is to begin based on theoffset into the primary content 32 that may detected responsive to thetrick mode request. It will further be appreciated that the author ofsecondary metadata 58 and a secondary application 60 may exercise thesame editorial control.

Other Examples Fast Forwarding Past the End of Secondary Content

A user that continues to fast forward after the secondary content 35(e.g., advertisement) has ended may, in one embodiment, view primarycontent 32 that may be rendered at an accelerated speed.

Example Embodiments Secondary Information

In response to the trick mode request, the communication module 38, inthe above described example embodiment, communicated advertisementsecondary information 39 in the form of the advertisement recording 54.It will be appreciated by one skilled in the art that other exampleembodiments may utilize different advertisement secondary information39. For example, other types of advertisement secondary information 39may include secondary metadata 58, secondary applications 60 orsecondary content 35 in the form of an advertisement slide show 70.

Example Embodiment Secondary Metadata

In response to the trick mode request, the communication module 38 mayutilize advertisement recording metadata 72 or the advertisement slideshow metadata 78, according to one embodiment. For example, theadvertisement recording metadata 72 may be processed by thecommunication module 38 to generate an advertisement recording 54 andthe advertisement recording metadata 72 may be processed by thecommunication module 38 to generate an advertisement slide show 70. Inboth examples, the communication module 38 may utilize the respectivemetadata 72, 74 to identify a subset of reference frames 86 andreference frame changes 84 in the associated advertisement asset 46 torespectively generate the advertisement recording 54 and theadvertisement recording metadata 72.

Example Embodiment Secondary Application

In response to the trick mode request, the communication module 38 mayutilize a secondary application 60, according to one embodiment. Forexample, the secondary application 60 may be embodied as theadvertisement application 76. The advertisement application 76 may beexecuted by the communication module 38 to generate secondary content 35in the form of the advertisement recording 54 or the advertisement slideshow.

Other Examples Medium and Presentation of Primary and Secondary Content

Other example may include primary content 32 and secondary content 35that may be embodied in one or more mediums (e.g., visual, audio,kinetic, etc.), the visual medium presented as motion or still. It willbe appreciated by one skilled in the art that the medium andpresentation of primary content 32 does not necessarily determine themedium and presentation of secondary content 35 and that any combinationof the medium and presentation of the primary content 35 may beassociated to secondary content in any combination of medium andpresentation. For example, primary content 32 embodied solely in audiomay be associated with secondary content 35 embodied as audio and visual(e.g., motion or still). In another embodiment, secondary content 35 mayinclude non-derivative secondary content 35 and derivative secondarycontent 35. For example, secondary content 35 may include video that maybe derived from the corresponding primary content 32 and audio that maynot be derived from the corresponding primary content 32.

Other Examples Entertainment Assets

It will be appreciated by one skilled in the art that primary content 32may also be embodied in the form of entertainment assets 46.Accordingly, the entertainment asset 46 may be associated tocorresponding entertainment secondary information 37 (e.g.,entertainment recording 52, entertainment slide show 62, entertainmentrecording metadata 64, entertainment slide show metadata 66,entertainment application 68).

Other Example Primary Content Played from Local Storage Device

Further, it will be appreciated by one skilled in the art that theprimary content 32 may not be immediately played on the output device 18but rather stored to a local storage device (e.g., memory, database 22)for later or delayed playback.

Other Examples Medium and Presentation of Primary and Secondary Content

Other example may include primary content 32 and secondary content 35that may be embodied in one or more mediums (e.g., visual, audio,kinetic, etc.), the visual medium presented as motion or still. It willbe appreciated by one skilled in the art that the medium andpresentation of primary content 32 does not necessarily determine themedium and presentation of secondary content 35 and that any combinationof the medium and presentation of the primary content 35 may beassociated to secondary content in any combination of medium andpresentation. For example, primary content 32 embodied solely in audiomay be associated with secondary content 35 embodied as audio and visual(e.g., motion or still). In another embodiment, secondary content 35 mayinclude non-derivative secondary content 35 and derivative secondarycontent 35. For example, secondary content 35 may include video that maybe derived from the corresponding primary content 32 and audio that maynot be derived from the corresponding primary content 32.

Other Example Non-Derivative Secondary Content

In response to the trick mode request, the communication module 38, inthe above described example embodiment, communicated derivativesecondary content (e.g., advertisement recording 54) for rendering to anoutput device 18 at a normal speed for the derivative secondary content.In another example, the communication module 38 may have communicatednon-derivative secondary content (e.g., advertisement recording 54).

FIG. 7 is a flowchart illustrating a method 160, according to an exampleembodiment, to identify secondary information 34 based on a trick moderequest. The method 160 commences at decision operation 162 with thecommunication module 38 determining the direction of the trick moderequest. If the communication module 38 determines that the trick moderequest is a fast forward request then a branch is made to decisionoperation 164. Otherwise, the communication module 38 determines thetrick mode request is a rewind or reverse request and branches todecision operation 172.

At decision operation 164, the communication module 38 determines thespeed of the trick mode request. If the communication module 38determines the trick mode request is twice-times normal speed then abranch is made to operation 166. If the communication module 38determines the trick mode request is four-times normal speed then abranch is made to operation 168. If the communication module 38determines speed of the trick mode request is eight-times the normalspeed then a branch is made to operation 170. At operations 166, 168 and170 the communication module 38 identifies two-times, four-times andeight-times normal fast forward versions respectively.

At decision operation 172 the communication module 38 determines thespeed of the rewind or reverse trick mode request. If the speed of therewind trick mode request is two-times, four-times, or six-times thenormal speed then a branch is made to operation 174, 176 and 178respectively.

FIG. 8 is a flowchart illustrating a method 180, according to an exampleembodiment. Illustrated on the right are operations performed on thereceiving device 12 and illustrated on the left are operations performedon the streaming server 28. The method 180 commences at the receivingdevice 12, at operation 181, with the user requesting an entertainmentasset 44. For example, the user may use a remote control 20 to select avideo on demand asset from a menu that is displayed on the displaydevice 26. In response to the user's request, the receiving device 12may communicate the request over the network 16 to the streaming server28. In an example embodiment the receiving device 12 and the streamingserver may utilize the real time streaming protocol (RTSP).

At operation 182, at the streaming server 28, the request module 36receives the request to play the video on demand asset. For example, therequest may include primary content identifier that may be used toaccess the appropriate entry in the entertainment asset table 40. Atoperation 183, the communication module 38 communicates (e.g., streams,playout) the entertainment asset 44 over the network 16 to the receivingdevice 12.

At operation 184, the receiving device 12 receives and renders theentertainment asset 44 to the display device 26 at the normal speed forthe entertainment asset 44.

At operation 185, at the streaming server 28, the communication module38 associates the primary content 32 to secondary information 34. Forexample, the communication module 38 may utilize the primary contentidentifier to identify corresponding secondary information 34 in theentertainment secondary information table 48 (e.g., entertainmentapplication).

At operation 186, at the streaming server 28, the communication module38 may communicate the entertainment application 68 to the receivingdevice 12. For example, the communication module 38 may communicate allversions of the entertainment application 68 (e.g., 2×FF VERSION, 4×FFVERSION, 6×FF VERSION, 2×REW VERSION, 4×REW VERSION, 6×REW VERSION) tothe receiving device 12.

At operation 187, the receiving device 12 receives and stores allversions of the entertainment application 68 on the database 22.

At operation 188, the user may select the fast forward button on theremote control 20 to accelerate the forward speed of the entertainmentasset. Responsive to the request, the receiving device 12 maycommunicate the fast forward trick mode request to the streaming server28. For example, the user may request fast forwarding at twice thenormal speed (e.g., 2×FF) of the advertisement asset 46 by pressing afast forward button on the remote control 20 once.

At operation 189, at the streaming server 28, the request module 36receives the trick mode request from the receiving device 12. Forexample, the trick mode request may include a primary contentidentifier, a direction identifier (e.g., forward or reverse) and aspeed identifier (e.g., 2×, 4×, 6×, etc.).

At operation 190, at the streaming server 28, the communication module38 stops streaming or communicating the entertainment asset 44 to thereceiving device 12. At operation 191, the communication module 38 fastforwards the entertainment asset 44.

At operation 192, the receiving device 12 executes the appropriateversion of the entertainment application 68 (e.g., 2×FF VERSION) togenerate non-derivative secondary content in the form of anentertainment slide show 62. At operation 193, the receiving device 12renders the entertainment slide show 62 to the output device 18.

At operation 194 the user requests the play mode by pressing the playbutton on the remote control 20. In response, at operation 195, thereceiving device 12 stops rendering the entertainment slide show 62 tothe output device 18 and communicates a play request to the streamingserver 28.

At operation 196, at the streaming server 28, the request module 36receives the request to play the entertainment asset 44. At operation196, the communication module 38 stops fast forwarding the entertainmentasset 44 and communicates (e.g., streams, playout) the entertainmentasset 44 over the network 16 to the receiving device 12.

At operation 198, the receiving device 12 receives and renders theentertainment asset 44 to the output device 18 at a normal speed for theadvertisement asset 44.

Other Example Embodiments

In response to the trick mode request, the receiving device 12, in theabove described example embodiment, utilized entertainment secondaryinformation 37 in the form of an entertainment application 68 togenerate an entertainment slide show 62. It will be appreciated by oneskilled in the art that other example embodiments may utilize differententertainment secondary information 37. For example, other types ofentertainment secondary information 37 may include secondary content 35and a secondary application 60 that may generate an entertainmentrecording 52.

Other Example Embodiments Secondary Content

In response to the trick mode request, the communication module 38, inother example embodiments, may render secondary content 35. For example,the secondary content 35 may include an entertainment recording 52 or anentertainment slide show 62.

Other Examples Advertisement Assets

Further, it will be appreciated by one skilled in the art that primarycontent 32 may also include an advertisement asset 46. Accordingly, theadvertisement asset 46 may be associated to corresponding advertisementsecondary information 39 (e.g., advertisement recording 54,advertisement slide show 70, advertisement application 76).

Other Examples Offsets into Primary and Secondary Content

As previously described, in like manner, the author of secondary content35 may exercise complete editorial control over selection of the offsetinto the secondary content 35 from which rendering is to begin based onthe offset into the primary content 32 that may detected responsive tothe trick mode request. It will further be appreciated that the authorof secondary metadata 58 and a secondary application 60 may exercise thesame editorial control.

Other Example Embodiments Primary Content Played from Local StorageDevice

Further, it will be appreciated by one skilled in the art that theprimary content 32 may not be immediately played on the output device 18but rather stored to a local storage device (e.g., memory, database 22)for later or delayed playback.

Other Examples Medium and Presentation of Primary and Secondary Content

Other example may include primary content 32 and secondary content 35that may be embodied in one or more mediums (e.g., visual, audio,kinetic, etc.), the visual medium presented as motion or still. It willbe appreciated by one skilled in the art that the medium andpresentation of primary content 32 does not necessarily determine themedium and presentation of secondary content 35 and that any combinationof the medium and presentation of the primary content 35 may beassociated to secondary content in any combination of medium andpresentation. For example, primary content 32 embodied solely in audiomay be associated with secondary content 35 embodied as audio and visual(e.g., motion or still). In another embodiment, secondary content 35 mayinclude non-derivative secondary content 35 and derivative secondarycontent 35. For example, secondary content 35 may include video that maybe derived from the corresponding primary content 32 and audio that maynot be derived from the corresponding primary content 32.

Other Example Derivative Secondary Content

In response to the trick mode request, in the above described exampleembodiment, the receiving device used the entertainment application 68to generate non-derivative secondary content (e.g., entertainment slideshow 62) for rendering to an output device 18. In another example, thereceiving device 12 may have used the entertainment application 68 togenerate derivative secondary content (e.g., entertainment slide show62) for rendering to the output device 18 at a normal speed for thederivative secondary content.

Other Examples Fast Forwarding Past the End of Secondary Content

A user that continues to fast forward after the secondary content 35(e.g., advertisement) has ended may, in one embodiment, result in thereceiving device 12 viewing corresponding primary content 32 that may berendered at an accelerated speed. For example, the receiving device 12may request the streaming server 28 to communicate primary content 32that may be rendered at an accelerated speed.

FIG. 9 is a block diagram illustrating a system 200, according to anexample embodiment, to modify simulated primary content 238 at areceiving device 12. The system 200 is shown to include a receivingdevice 12, a network 16 and a video on demand system 206.

The receiving device 12 has previously been described. Furtherdescription is provided below for previously unmentioned components. Thereceiving device 12 may include a decoder system 208, a processor 210, amemory 212, a content communication module 216, a demultiplexer 217, anaudio module 219, a video module 221, a descrambler 225, a receivingmodule 218, control buttons 19, an interface 222, and an interface 223,and a local storage device 309.

The processor 210 may execute instructions and move data to and from thememory 212 and the memory 226. The content communication module 216 mayreceive primary content 32 and/or simulated primary content 238 from thenetwork 204 via the interface 223 and communicate the primary content 32and simulated primary content 238 to the demultiplexer 217. Further, thecontent communication module 216 may utilize the simulated primarycontent 238 to generate the secondary content 35 in the form of aprogrammatically generated entertainment slide show, a programmaticallygenerated entertainment recording, a programmatically generatedadvertisement slide show, or a programmatically generated advertisementrecording. The receiving module 218 may receive a request from thecontrol buttons 19 or the remote control 20. For example, the receivingmodule 218 may receive a request to fast forward or reverse (e.g.,rewind) primary content at an accelerated speed that may be 2×, 4×, or6× normal speed. The demultiplexer 217 may demultiplex the primarycontent 32 and the simulated primary content 238 into audio, video, andmetadata streams that may be respectively communicated to the audiomodule 219, the video module 221 and the descrambler 225. The metadatastream may include descrambling information that includes conditionalaccess decryption keys that may be used by the descrambler 225 todescramble or decrypt the audio and video streams. Other embodiments maynot include the descrambler 225. The audio module 219 may process theaudio and communicate the audio to the memory 226. Similarly, the videomodule 221 may process the video and communicate the video to the memory226.

The decoder system 208 is shown to include a processor 224, a memory226, a decoder 230 and a render module 234. The processor 224 may beused for executing instructions and moving data. For example, theprocessor 224 may be used to move the primary content 32, the simulatedprimary content 238 or other data from the memory 226 to the decoder230. The decoder 230 may decode the packets/frames into image and sounddata. The render module 234 may render the sound data to the sounddevice 24 and render image data to the display device 26.

The local storage device 309 may include a circular buffer that includesboth the memory 226 and the database 22. The circular buffer may beutilized by the receiving device 12 to store the primary content 32and/or simulated primary content 238. For example, a user may bewatching a movie and select a pause button on the remote control 20 toanswer a telephone call. Responsive to selection of the pause button,the movie may be stored in the circular buffer. Subsequent to completingthe telephone call the user may select the play button on the remotecontrol 20 to prompt the receiving device 12 to resume rendering of themove to the output device 18 by retrieving the movie from the circularbuffer. In addition, the local storage device 309 may include a filestructure for storing and retrieving the primary content 32 and/orsimulated primary content 238.

The video on demand system 206 is shown to include a streaming server 28and a database 235. The streaming server 28 responds to requests forprimary content 32 by reading primary content 32 from the database 235and communicating the primary content 32 over the network 16 to thereceiving device 12. Further, the streaming server 28 may respond to atrick mode request by associating the primary content 32 to simulatedprimary content 238 and communicating (e.g., stream, playout) thesimulated primary content 238 over the network 14 to the receivingdevice 12.

Generally speaking, a user may operate the control buttons 19 or theremote control 20 to fast forward or rewind (e.g., reverse) the primarycontent 32 that is presently rendered on the output device 18. Inresponse to receiving the trick mode request, the receiving device 12may communicate the trick mode request over the network 204 to thestreaming server 28. The streaming server 28 may receive the primarycontent 32 and associate the primary content 32 to simulated primarycontent 238. Next, the streaming server 28 may communicate the simulatedprimary content 238 to the receiving device 12. At the receiving device12, the content communication module 216 may receive the simulatedprimary content 238 and utilize the simulated primer content 238 togenerate derivative secondary content. For example, the generatedderivative secondary content may be embodied as a programmaticallygenerated entertainment slide show. Finally, the programmaticallygenerated entertainment slide show may be rendered to the output device18 at a normal speed.

While the system 10 shown in FIG. 9 employs a client-serverarchitecture, the present disclosure is of course not limited to such anarchitecture, and could equally well find application in a distributed,or peer-to-peer, architecture system. The content communication module216 and the receiving module 218 may also be implemented as standalonesoftware programs, which do not necessarily have networkingcapabilities.

FIG. 10 is a block diagram illustrating a database 235, according to anexample embodiment. The database 235 includes an entertainment assettable 40 as previously described, an advertisement asset table 42 aspreviously described, an entertainment simulated primary content table236, and an advertisement simulated primary content table 241.

The entertainment simulated primary content table 236 contains simulatedprimary content 238 in the form of accelerated speed entertainmentassets 240. Each accelerated speed entertainment assets 240 may beassociated with a corresponding entertainment asset 44. For example, thestreaming server 28 may associate the entertainment asset 44 to theappropriate accelerated speed entertainment asset 240 responsive toreceiving a trick mode request. The accelerated speed entertainmentasset 240 may be a prerecorded version of the entertainment asset 44played at an accelerated speed. In an example embodiment, theaccelerated speed entertainment asset 240 may be prerecorded atdifferent speeds and directions (e.g., 2× or 4× or 6×—Fast forward or 2×or 4× or 6×—Rewind).

The advertisement simulated primary content table 241 contains simulatedprimary content 238 in the form of accelerated speed advertisementassets 242. Each accelerated speed advertisement asset 242 may beassociated with an advertisement asset 46. For example, the streamingserver 28 may associate the advertisement asset 46 to the correspondingaccelerated speed advertisement asset 242 responsive to receiving atrick mode request. The accelerated speed advertisement asset 242 may bea prerecorded version of the advertisement asset 46 played at anaccelerated speed. In an example embodiment, the accelerated speedadvertisement asset 242 may be prerecorded at different speeds anddirections (e.g., 2× or 4× or 6×—Fast forward or 2× or 4× or 6×—Rewind).

FIG. 11 is a flow chart illustrating a method 250, according to anexample embodiment, to modify simulated primary content 238 at areceiving device 12. Operations performed by the receiving device 12 areillustrated on the right and operations performed by the streamingserver 28 are illustrated on the left. The method 250 commences at thereceiving device 12, at operation 252 where the user requests anentertainment asset 44 that may be communicated to the streaming server28.

At operation 254, the streaming server 28 receives the request to playthe entertainment asset 44 and retrieves the requested entertainmentasset 44 from the database 235. For example, the request to play theentertainment asset 44 asset may include an entertainment assetidentifier that may be used to access the requested entertainment asset44 in the entertainment asset table 40. At operation 256, the streamingserver 28 communicates the entertainment asset 44 to the receivingdevice 12.

At operation 258, at the receiving device 12, the content communicationmodule 216 receives the entertainment asset 44 and communicates theentertainment asset 44 to the demultiplexer 217 that demultiplexes theentertainment asset 44 into audio, video, and metadata streams that arerespectively communicated to the audio module 219, the video module 221and descrambler 225. The audio module 219, the video module 221, and thedescrambler 225 process the respective streams and communicate theresults to the memory 226. For example, the descrambler 225 may utilizeconditional access decryption keys in the metadata to interact with theaudio module 219 and the video module 221 to decrypt or descramble thevideo and/or the audio.

At operation 260, the decoder 23, in the decoder system 208, decodes theentertainment asset 44 and communicates the entertainment asset 44 tothe render module 234. At operation 260, the render module 234 rendersthe entertainment asset 44 to the output device 18 including the displaydevice 26 and the sound device 24 at normal speed.

At operation 262, at the receiving device 12, the user enters a trickmode request (e.g., Fast Forward 2× normal speed) via the remote control20 that is received by the receiving module 218 at the receiving device12. The receiving module 218 may communicate the trick mode request overthe network 204 to the streaming server 28. In an example embodiment thetrick mode request may be communicated utilizing the real time streamingprotocol.

At operation 264, the streaming server 28 receives the trick moderequest from the receiving device 12. At operation 265, the streamingserver 28 associates the entertainment asset 44 that is currently beingcommunicated (e.g, streamed) to the receiving device 12 to thecorresponding accelerated speed entertainment asset 240 and at operation266 the streaming server 28 communicates the accelerated speedentertainment asset 240 to the receiving device 12.

At operation 268, at the receiving device 12, the content communicationmodule 216 receives the accelerated speed entertainment asset 240 andcommunicates the accelerated speed entertainment asset 240 to thedemultiplexer 217 that demultiplexes the entertainment asset 44 intoaudio, video, and metadata streams that are respectively communicated tothe audio module 219, the video module 221 and descrambler 225. Theaudio module 219, the video module 221, and the descrambler 225 processthe respective streams and communicate the results to the memory 226.For example, the descrambler 225 may utilize conditional accessdecryption keys in the metadata to interact with the audio module 219and the video module 221 to decrypt or descramble the video and/or theaudio.

At operation 270, the content communication module 216 generatessecondary derivative content (e.g., programmatically generatedentertainment slide show) from the accelerated speed entertainment asset240. For example, the programmatically generated entertainment slideshow may include reference frames 86 selected by the contentcommunication module 216 from the accelerated speed entertainment asset240 stored in the memory 226. In an example embodiment, the contentcommunication module 216 may select reference frames by identifyingdifferent scenes in the accelerated speed entertainment asset 240.Further the content communication module 216 may add fade-ins andfade-outs. Next, the content communication module 216 communicates theprogrammatically generated entertainment slide show to the decoder 230that decodes the programmatically generated entertainment slide show andcommunicates the programmatically generated entertainment slide show tothe render module 234.

At operation 272, the render module 234 renders a programmaticallygenerated entertainment slide show to the output device 18 at normalspeed.

At operation 274, the receiving module 218 receives a play request thatmay be entered by the user via the remote control 20 or control buttons19 and communicates the play request to the streaming server 28.

At operation 276, the streaming server 28 receives the request from thereceiving device 12. At operation 278, the streaming server 28 mayidentify a location in the entertainment asset 44 based on the elapsedtime from receipt of the fast forward request to receipt of the playrequest and may resume communicating (e.g., streaming) the entertainmentasset 44 to the receiving device 12.

At operation 280, at the receiving device 12, the render module 234renders the entertainment asset 44 to the output device 18 at normalspeed.

Other Example Embodiments

The content communication module 216 in the above example embodimentgenerated a programmatically generated entertainment slide show,however, it will be appreciated that other example embodiments maygenerate a programmatically generated entertainment recording,programmatically generated advertisement slide show, and aprogrammatically generated advertisement recording.

Other Examples Offsets into Primary and Secondary Content

As previously described, in like manner, the author of the contentcommunication module 216 may exercise complete editorial control, viathe communication module 216, over the selection of the offset into thesimulated primary content 238 from which rendering is to begin based onthe offset into the primary content 32 that may detected responsive tothe trick mode request.

FIG. 12 is a block diagram illustrating a system 290, according to anexample embodiment. The system 290 may be utilized to communicate atransmission that facilitates modification of playback of primarycontent 32 at a receiving device 12.

The system 290 includes a receiving device 12, a broadcast system 292and a video on demand system 294. The broadcast system 292 includes anentertainment server 296 and an insertion system 298 that includes anadvertisement server 304, a live feed 302 and an insertion server 308.

Broadly speaking, the insertion server 308 may receive and a componenttransmission 291 (e.g., Internet Protocol (IP) that includes a streamthat is formatted in MPEG-2 compression format from a live feed 302, acomponent transmission 293 that includes a stream that is formatted inan MPEG-2 compression format from the entertainment server 296, and acomponent transmission 295 that includes a stream that is formatted inan MPEG-2 compression format from the advertisement server 304. Thecomponent transmission 291 that is received from the live feed 302 mayinclude primary content 32 and secondary information 34 that is live(e.g., sporting events, election results, etc.). Accordingly, theprimary content 32 received from the live feed 302 may include anentertainment asset 44 (e.g. live content) and an advertisement asset 46(e.g. live content). Likewise, the secondary information 34 receivedfrom the live feed 302 may include an entertainment recording 52 (e.g.live content), an entertainment slide show 62 (e.g. live content), anadvertisement recording 54 (e.g. live content), and an advertisementslide show (e.g. live content).

Each of the component transmissions 291, 293, 295 may include multiplechannels. Each channel may include multiple packetized elementarystreams that carry audio and/or visual, and/or metadata. Other exampleembodiments may include component transmissions 291, 293, 295 embodiedin other transport formats (e.g., IP) and compression formats (e.g.,MPEG-4, VC1, etc.). The transmission from the advertisement server 304may carry primary content 32 in the form of advertisement assets 46 andsecondary information 34 relating to advertisements. The transmissionfrom the entertainment server 296 may carry primary content 32 in theform of entertainment assets 44 and secondary information 34 relating toentertainment. Next, the insertion server 308 may utilize the componenttransmissions 291, 293, 295 to generate a transmission 297 that iscommunicated over the network 16 to the receiving device 12. Otherexample embodiments may include the transmission 297 embodied in othercompression formats (e.g., MPEG-4, VC1) or other transport formats(e.g., Internet Protocol (IP)). The secondary information 34 may includea secondary information identifier that may be used by the receivingdevice 12 to associate the primary content 32 to secondary content 35that may be played out at the output device 18 at the receiving device12 responsive to receiving a trick mode request.

The entertainment server 296 is coupled to a database 300 that mayinclude primary content 32 and secondary entertainment information 37 aspreviously described.

The advertisement server 304 is shown to be coupled to a database 306that may include primary content 32 and advertisement secondaryinformation 39 as previously described. The insertion server 308 isshown to include a transport module 310 and a transmission module 312.The transport module 310 may receive the component transmission 291 fromthe live feed 302 and the component transmission 293 from theentertainment server 296 and the component transmission 295 from theadvertisement server 304. Further, the transport module 310 may generatethe transmission 297 based on the component transmission 291 from thelive feed 302 and the component transmission 293 received from theentertainment server 296 and the component transmission 295 receivedfrom the advertisement server 304. The transmission module 312 maycommunicate the transmission 297 to the receiving device 12.

The video on demand system 294 includes the streaming server 28 that isshown to be coupled to a remote storage device 316 that may include adatabase 317 that may include secondary information 34. The receivingdevice 12 may utilize the secondary information 34 received in thetransmission 297 to request additional secondary information 34 that isstored on the remote storage device 316.

While the system 290 shown in FIG. 12 employs a client-serverarchitecture between the receiving device 12 and the video on demandserver 28, the present disclosure is of course not limited to such anarchitecture, and could equally well find application in a distributed,or peer-to-peer, architecture system.

FIG. 13 is a block diagram illustrating a database 300, according to anexample embodiment. The database 300 is coupled to the entertainmentserver 296 and is shown to include the entertainment asset table 40 andthe entertainment secondary information table 48 as previouslydescribed. The entertainment secondary information table 48 is shown toinclude multiple entries of entertainment recordings 52; however, itwill be appreciated by a person having ordinary skill in the art thatother example embodiments of the entertainment secondary informationtable 48 may include other forms of secondary information 34 includingthe entertainment slide show 62, the entertainment recording metadata64, the entertainment slide show metadata 66, and the entertainmentapplication 68 all as previously described.

FIG. 14 is a block diagram illustrating a database 306, according to anexample embodiment. The database 306 is coupled to the advertisementserver 304 and is shown to include the advertisement asset table 42 andthe advertisement secondary information table 50 as previouslydescribed. The advertisement secondary information table 50 is shown toinclude multiple entries of advertisement recordings 54; however, itwill be appreciated by a person having ordinary skill in the art thatother example embodiments of the advertisement secondary informationtable 50 may include other forms of secondary information 34 includingthe advertisement slide show 70, the advertisement recording metadata72, the advertisement slide show metadata 74, and the advertisementapplication 76 all as previously described.

FIG. 15 is a block diagram illustrating the receiving device 12,according to an example embodiment. The receiving device 12 haspreviously been described. Further description is provided below forpreviously unmentioned components or functions.

The receiving device 12 includes a demultiplexer 217, a local storagedevice 309, and a processing module 322. The demultiplexer may receive atransmission 297 from the insertion system 298, demultiplexes thetransmission 297 according to channels and stores the demultiplexedtransmission 297 in the local storage device 309. For example, in oneembodiment, the demultiplexer 217 may utilize the audio module 219, thevideo module 221, and the descrambler 225 to process and store thetransmission 297 in the local storage device 309. In addition, thedemultiplexer 217 may identify secondary information 34 in the form ofsecondary content 35, secondary metadata 58, and a secondary application60 in the demultiplexed transmission 297 and store the secondary content35, secondary metadata 58, and a secondary application 60 as addressablefiles on the local storage device 309.

The local storage device 309 may include a circular buffer that includesboth the memory 226 and the database 22. The circular buffer may beutilized by the receiving device 12 to store the transmission 297. Forexample, a user may be watching a baseball game that is broadcast liveand select a pause button on the remote control 20 to answer a telephonecall. Responsive to selection of the pause button, the transmission 297may be stored in the circular buffer. Subsequent to completing thetelephone call the user may select the play button on the remote control20 to prompt the receiving device 12 to resume rendering of the baseballgame to the output device 18 by retrieving the transmission 297 from thecircular buffer and processing the transmission 297. In addition, thelocal storage device 309 may include a file structure for storing andretrieving the secondary information 34 including secondary content 56,the secondary metadata 58 and secondary applications 60. Accordingly, inan example embodiment, the local storage device 309 may be utilized tostore secondary information 34 in the form of an addressable file (e.g.,accessed with a URL) or in the form of a transmission 297.

The processing module 322 may receive and process requests. For example,the processing module 322 may process a request to render primarycontent 32 to the output device 18 at an accelerated speed of theprimary content. The processing module 322 may receive the request fromthe remote control 20 or the control buttons 19. Responsive to receivingthe request, the processing module 322 may associate the primary content32 to secondary content 35 based on secondary information 34 in the formof a secondary information identifier that is included in thetransmission 297 received by the multiplexer 214.

FIG. 16A is a block diagram illustrating a component transmission 292,according to an example embodiment. The component transmission 292 maybe communicated by the live feed 302 and received by the insertionserver 308. The component transmission 292 may include multiple channels323 that may carry entertainment assets 44, advertisement assets 46 andassociated secondary information 34 as described further below.

FIG. 16B is a block diagram illustrating a component transmission 293,according to an example embodiment. The component transmission 293 maybe communicated by the entertainment server 298 and received by theinsertion server 308. The component transmission 293 may includemultiple channels 323 that may carry entertainment assets 44 andassociated secondary information 34 as described further below.

FIG. 16C is a block diagram illustrating a component transmission 295,according to an example embodiment. The component transmission 295 maybe communicated by the advertisement server 304 and received by theinsertion server 308. The component transmission 295 may includemultiple channels 323 that may carry advertisement assets 46 andassociated secondary information 34 as described further below.

FIG. 16D is a block diagram illustrating a transmission 297, accordingto an example embodiment. The transmission 297 may be communicated bythe insertion server 308 and received by the receiving device 12. Thetransmission 297 may be generated based the component transmission 291,as shown in FIG. 16A, received from the live feed 302 and the componenttransmission 293, as shown in FIG. 16B, received from the entertainmentserver 296 and the component transmission 295, as shown in FIG. 16C,received from the advertisement server 304. The transmission 297 mayinclude multiple channels 323 that may be selected by the user via theremote control 20 or the control buttons 19. The transmission 297 maycarry entertainment assets 44 and corresponding secondary information34, advertisement assets 46 and corresponding secondary information.

FIG. 17 is a block diagram illustrating multiple streams associated witha single channel 323, according to an example embodiment. The streamsmay include a video stream 327, an audio stream 329, and a metadatastream 331. Each stream 327 may be embodied as packets 82 that may bereceived at the demultiplexer 217 as they enter the receiving device 12.The demultiplexer 217 may concatenate the payload of the packets togenerate frames 80. The frames 80 are shown to include reference frames86 and reference frame changes 84 as previously described. The referenceframes 86, the reference frame changes 84, and the metadata frames 87may be descrambled and communicated to the decoder 230. The decoder 230may decode the frames 80 into image data and sound data and communicatethe image data and sound data to the render module 234 that renders theimage and sound data to the output device 18 including the displaydevice 26 and the sound device 24.

FIG. 18 is a block diagram illustrating the packet 82, according to anexample embodiment. The packet 82 is shown to include a header 340 and apayload 342. The header 340 may include a stream identifier 344 that maybe used to identify packets 82 of a single stream. For example, a firststream identifier may identify a first stream carrying packets 82 with avideo payload, a second stream identifier may identify a second streamthat may include packets 82 carrying an audio payload, and a thirdstream identifier may identify a third stream 327 that includes packets82 carrying a metadata payload. The payload 342 may include frameinformation to construct the frames 80.

FIG. 19 is a block diagram illustrating secondary information 34 in theform of a secondary information table 350, according to an exampleembodiment. The secondary information table 350 may be carried in themetadata stream 331 of a channel 323 and may be read by the processingmodule 322 responsive to the receiving device 12 receiving a trick moderequest. The secondary information table 350 may be utilized by theprocessing module 322 to identify the location of additional secondaryinformation 34. The secondary information table 350 may include entriesthat correspond to the type of trick mode request. For example, trickmode requests may include fast forward and rewind versions ataccelerated speeds as previously described. Each trick mode request isassociated with a secondary information identifier 352 and a secondaryinformation offset 354. The secondary information identifier 352 mayidentify the location of the secondary information 34. For example, thesecondary information identifier may identify the audio stream 329 andvideo stream 327 of a channel that may be currently rendered to theoutput device 18, the metadata stream 331 of a channel that may becurrently rendered to the output device 18, a channel 323 that isdifferent from the channel 323 that is currently being rendered to theoutput device 18, a file on the local storage device 309 or a file onthe remote storage device 316. The secondary information offset 354 maybe utilized to identify an offset from the beginning of the identifiedsecondary information 34. For example, the secondary information offset354 may be expressed in bytes or time from the start of the identifiedsecondary information 34.

FIG. 20 is a block diagram illustrating primary content 32 and secondaryinformation 34 communicated in the video stream 327 and the audio stream329 of a single channel 323, according to an example embodiment. Thechannel 323 is shown to include the video stream 327 communicatingprimary content 32 and secondary information 34, the audio stream 329communicating primary content 32 and secondary information 34, and themetadata stream 331 communicating metadata and a secondary informationtable 350. Responsive to the primary content 32 being rendered to theoutput device 18 and receipt of a trick mode request, the secondaryinformation table 350 may be accessed by the processing module 322 toidentify the location of the secondary information 34 in the videostream 327 and audio stream of the same channel 323.

FIG. 21 is a block diagram illustrating primary content 32 communicatedin a first channel 323 and secondary information 34 communicated in asecond channel 323, according to an example embodiment. The firstchannel 323 is shown to include the video stream 327 communicatingprimary content 32, the audio stream 329 stream 327 communicatingprimary content 32, and the metadata stream 331 communicating metadataand a secondary information table 350. Responsive to the primary content32 being rendered to the output device 18 and receipt of a trick moderequest, the secondary information table 350 may be accessed by theprocessing module 322 to identify the location of the secondaryinformation 34 in the video stream 327 and audio stream of the secondchannel 323.

FIG. 22 is a block diagram illustrating the primary content 32communicated in the video stream 327 and the audio stream 329 of achannel 323 and the secondary information 34 communicated in a metadatastream 331 of the same channel 323, according to an example embodiment.The channel 323 is shown to include the video stream 327 communicatingthe primary content 32, the audio stream 329 communicating the primarycontent 32, and the metadata stream 331 communicating metadata, asecondary information table 350, and secondary information 34.Responsive to the primary content 32 being rendered to the output device18 and receipt of a trick mode request, the secondary information table350 may be accessed by the processing module 322 to identify thelocation of the secondary information 34 in the metadata stream 331 ofthe same channel 323.

FIG. 23 is a block diagram illustrating a transmission 297 includingprimary content 32 that includes end of primary content markers 361,according to an example embodiment. The transmission 297 is shown toinclude primary content 32 in the form of an entertainment asset 44 andan advertisement asset 46 and respectively corresponding secondarycontent 35 in the form of an entertainment recording 52 and anadvertisement recording 54. The end of primary content markers 361 maybe used by the processing module 322 to identify a location in theprimary content 32 to resume play. For example, responsive to receipt ofa play request while rendering the entertainment recording 52 to theoutput device 18, the processing module 322 may skip to the end ofprimary content marker 361 associated with the entertainment asset 44.Also for example, responsive to receipt of a play request whilerendering the advertisement recording 54 to the output device 18, theprocessing module 322 may skip to the end of primary content marker 361associated with the advertisement asset 46. Other example embodimentsmay utilize other forms of secondary content 35 (e.g., advertisementslide show 70 and entertainment slide show 62).

FIG. 24 is flowchart illustrating the method 370, according to anexample embodiment, to modify playback of primary content 32 a receivingdevice 12. The operation 370 commences at operation 374 with thedemultiplexer 217 receiving the transmission 297 via the interface 223.The transmission 297 may include primary content 32 and a secondaryinformation table 360 that may include secondary information identifiers352. The demultiplexer 217 may demultiplex the transmission 297according to channels 323 and store the demultiplexed transmission 297as packets 82 in the local storage device 309. For example, thedemultiplexer 217 may utilize the audio module 219, the video module 221and the descrambler 225 to store the demultiplexed transmission 297.Other example embodiments may include a demultiplexer 217 that furtherdepacketizes the transmission 297 and concatenates the payloads 342 togenerate frames 86 that may be stored in the local storage device 309.

At operation 376, the descrambler 225 may identify the streams 327, 329,331 (video, audio, metadata) in the transmission 297 associated with themost recent channel request received at the receiving device 12 anddescramble the identified streams 327, 329, 331 based on descramblinginformation in the metadata stream 331. For example, the user may haverequested the channel 323 that carries ESPN (e.g., the ESPN channel).Further, the processor 224, in the decoder system 208, may communicatethe descrambled streams 327, 329, 331 to the decoder 230.

At operation 380, the decoder 230 decodes the primary content 32 in theidentified streams 327 and communicates the primary content 32 to therender module 234.

At operation 382, the render module 234 renders the primary content 32to the output device 18 that may include the display device 26 and thesound device 24. For example, the render module 234 may render anentertainment asset 44 (e.g., 2006 World Cup Soccer Game) to the outputdevice 18.

At operation 384, the processing module 322 receives a pause request viathe control buttons 19 to pause the rendering of the 2006 World CupSoccer Game to the output device 18. The processing module 322, in turn,may communicate the request to the descrambler 228 and the decodersystem 208. The descrambler 228 stops descrambling packets 82 and thedecoder system 208 stops retrieving the descrambled streams from thestorage device 309. Accordingly, the demultiplexer 217 continues tostore the transmission 297 to the memory 226 with possible overflow tothe database 22.

At operation 386, the processing module 322 receives a play request viathe control buttons 19. The processing module 322, in turn, maycommunicate the play request to the decoder system 208 and thedescrambler 225. The descrambler 225 may respond by descrambling. Theprocessor 224, in the decoder system 208, in turn, may respond byretrieving or reading the descrambled steams (e.g., transmission 297)from the local storage device 309 that may subsequently be utilized torender primary content 32 to the output device 18 at a normal speed forthe primary content 32.

At operation 388, the processing module 322 receives a trick moderequest via the remote control 20 to render the primary content 32 atthe output device 18 at an accelerated speed. For example, theprocessing module 322 may receive a request to fast forward the primarycontent 327 at six-times the normal speed (e.g., 6×FF VERSION).

At operation 390, the processing module 322 may modify the playback ofprimary content 32 by associating the primary content 32 to thesecondary content 35 responsive to receiving the trick mode request. Forexample, the processing module 322 may retrieve the secondaryinformation table 350 from the metadata stream 331 associated with thechannel 323 that carries ESPN (e.g., primary content 32). Further theprocessing module 322 may identify the secondary information identifier352 and the secondary information offset 354 in the secondaryinformation table 350 based on the trick mode request (e.g., 6×FFVERSION). In the present example embodiment, the secondary informationtable 350 may identify the secondary information 34 as located in avideo stream 327 and an audio stream 329 of a channel 323 different fromthe channel 323 that carries ESPN. Accordingly, the processing module322 may, in an example embodiment, communicate the identified channel323 to the descrambler 328 that, in turn, processes the correspondingmetadata stream 331, video stream 327 and audio stream 329. For example,the descrambler 328 may utilize the descrambling information in themetadata stream 331 to descramble the video stream 327 and audio stream329. In the present example, the descrambler 328 descrambles secondaryinformation 34 in the form of an entertainment application 68.

At operation 391, the processing module 322 completes the association ofprimary content 32 to secondary content 35 by causing the entertainmentapplication 68 to execute. The entertainment application 68 executes togenerate secondary content 35 in the form of an entertainment recording52.

At operation 392, the decoder 230 decodes the entertainment recording 52and communicates the decoded entertainment recording 52 to the rendermodule 234.

At operation 393, the render module 234 may render the entertainmentrecording 52 to the output device 18 including the display device 26 andthe sound device 24 at a normal speed of the entertainment recording 52.For example, the entertainment recording 52 may introduce the players ofthe teams participating in the 2006 World Cup Soccer Game.

At operation 394, the processing module 322 may receive a play requestvia the control buttons 19. The processing module 322, in turn, maycommunicate the ESPN channel 323 to the descrambler 228 that, in turn,descrambles the associated streams 327, 329, 331 based on the identifiedESPN channel 323. Next, the processing module 322 identifies the end ofprimary content marker 361 in the primary content 32 (e.g., 2006 WorldCup Soccer Game) and communicates the identified location to the decodersystem 206. The processor 224, in the decoder system 208, in turn,communicates the video, audio, and metadata streams 327, 329, 331 thathave been identified based on the location to the decoder 230.

At operation 395, the decoder 230 decodes the primary content 32 (e.g.,2006 World Cup Soccer Game).

At operation 396, the render module 234 renders the primary content 21in the form of the entertainment asset 44 (e.g., 2006 World Cup SoccerGame) to the output device 18.

Other Example Embodiments Location of Secondary Information

The processing module 322 in the above described example embodimentutilized a secondary information identifier 352 to identify a channel323 in the transmission 297 that carried secondary information 34 in theform of the entertainment application 68. Other example embodiments,however, may identify other locations from which to retrieve thesecondary information 34 (e.g., entertainment application 68). Forexample, the secondary information identifier 352 may further identifythe secondary information 34 as located in the audio streams 329 andvideo stream 327 of the channel 323 that is currently being rendered tothe output device 18 (e.g., ESPN channel), the metadata stream 331 ofthe channel 323 that is currently being rendered to the output device18, the local storage device 309 or the remote storage device 316.

Other Example Embodiment Same Channel Audio and Video Streams

In this example embodiment the processing module 322 may utilize thesecondary information identifier 352 (e.g., stream, stream, channel) toretrieve the secondary information 34 (e.g., entertainment application68) from the audio stream 329 and the video streams 327 of the ESPNchannel 323 responsive to receipt of a trick mode request. Further, thedecoder 230 may retrieve the primary content 32 from the audio stream329 and the video streams 327 in the absence of processing a trick moderequest.

Other Example Embodiment Same Channel Metadata Stream

In this example embodiment the processing module 322 may utilize thesecondary information identifier 352 (e.g., stream, channel) to retrievethe secondary information 34 (e.g., entertainment application 68) fromthe metadata stream 331 of the ESPN channel 323 responsive to receipt ofa trick mode request. Further, the processing module 322 may retrievethe primary content 32 from metadata stream 331 in the absence ofprocessing a trick mode request.

Other Example Embodiment Local Storage Device

In this example embodiment the processing module 322 may utilize thesecondary information identifier (e.g., URL) to retrieve the secondaryinformation 34 (e.g., entertainment application 68) from the localstorage device 309. Accordingly this example embodiment requires thedemultiplexer 217 to retrieve the secondary information 34 (e.g.,entertainment application 68) from the transmission 297 and to store theretrieved secondary information 34 in the form of an addressable file onthe local storage device 309. It will be appreciated that the secondaryinformation 34 (e.g., entertainment application 68) may be stored on thelocal storage device 309 asynchronous to receipt of the correspondingprimary content 32. For example, as described above, the secondaryinformation 34 (e.g., entertainment application 68) utilized by theprocessing module 322 to generate the entertainment recording 52 mayhave been received and stored on the local storage device 309 devicethree days before the receiving device 12 received the entertainmentasset 44 (e.g., 2006 World Cup Soccer Game). Indeed, the secondaryinformation 34 (e.g., entertainment application 68) may be stored on thelocal storage device 309 any time (e.g., seconds, hours, months, days,etc.) prior to receipt of the corresponding primary content 32.

Other Example Embodiment Remote Storage Device

In this example embodiment the processing module 322 may utilize thesecondary information identifier (e.g., URL) to retrieve a file from aremote storage device 316 that contains the secondary information 34(e.g., entertainment application 68). Secondary information 34 may bestored on the remote storage device 316 asynchronous to receipt of theassociated primary content 32 at the receiving device 12.

Other Example Embodiments Secondary Information

The processing module 322 in the above described example embodimentassociated primary content 32 in the form of an entertainment asset 44(e.g., 2006 World Cup Soccer Game) to corresponding secondary content 35in the form of an entertainment recording 52 (e.g., Introduction of theplayers of the teams participating in the 2006 World Cup Soccer Game).The processing module 322 generated the secondary content 35 byexecuting the entertainment application 68. Other example embodimentsmay utilize other types of secondary information 34. For example, othersecondary information 34 may include secondary content 35, secondarymetadata 58 or a secondary application 60 to generate an entertainmentslide show 62.

Other Example Embodiments Secondary Content

The secondary content 35 may include an entertainment recording 52 or anentertainment slide show 62. The processing module 322 may immediatelyutilize the secondary content 35.

Other Example Embodiments Secondary Metadata

The secondary metadata 58 may include entertainment recording metadata64 or entertainment slide show metadata 66 that may be utilized by theprocessing module 322 to generate secondary content 35. For example, theprocessing module 322 may use the secondary metadata 58 in the form ofentertainment recording metadata 64 to identify reference frames 86reference frame changes 84 in the primary content 32 to generate anentertainment recording 52. In another example the processing module 322may use the secondary metadata 58 to identify reference frames 86 andadd fade-ins and fade-outs to generate an entertainment slide show 62.

Other Example Embodiments Secondary Application

Finally, the secondary application 60 may further be executed by theprocessing module 322 to generate an entertainment slide show 62.

Other Examples Advertisement Assets

Further, it will be appreciated by one skilled in the art that primarycontent 32 may also include an advertisement asset 46. Accordingly, theadvertisement asset 46 may be associated to corresponding advertisementsecondary information 39 (e.g., advertisement recording 54,advertisement slide show 70, advertisement recording metadata 72,advertisement slide show metadata, advertisement application 76).

Other Examples Medium and Presentation of Primary and Secondary Content

Other example may include primary content 32 and secondary content 35that may be embodied in one or more mediums (e.g., visual, audio,kinetic, etc.), the visual medium presented as motion or still. It willbe appreciated by one skilled in the art that the medium andpresentation of primary content 32 does not necessarily determine themedium and presentation of secondary content 35 and that any combinationof the medium and presentation of the primary content 3 may beassociated to secondary content in any combination of medium andpresentation. For example, primary content 32 embodied solely in audiomay be associated with secondary content 35 embodied as audio and visual(e.g., motion or still). In another embodiment, secondary content 35 mayinclude non-derivative secondary content 35 and derivative secondarycontent 35. For example, secondary content 35 may include video that maybe derived from the corresponding primary content 32 and audio that maynot be derived from the corresponding primary content 32.

Other Example Non-Derivative Secondary Content

In response to the trick mode request, in the above described exampleembodiment, the processing module 322 generated derivative secondarycontent (e.g., entertainment recording 52) for rendering to an outputdevice 18 at a normal speed for the derivative secondary content. Inanother example, the processing module 322 may generate non-derivativesecondary content (e.g., advertisement recording 54) for rendering tothe output device 18.

Other Examples Offsets into Primary and Secondary Content

As previously described, in like manner, the author of secondary content35 may exercise complete editorial control over selection of the offsetinto the secondary content 35 from which rendering is to begin based onthe offset into the primary content 32 that may detected responsive tothe trick mode request. It will further be appreciated that the authorof secondary metadata 58 and a secondary application 60 may exercise thesame editorial control.

Other Examples Fast Forwarding Past the End of Secondary Content

A user that continues to fast forward after the secondary content 35(e.g., advertisement) has ended may, in one embodiment, viewcorresponding primary content 32 that may be rendered at an acceleratedspeed.

FIG. 25 is a flow chart illustrating a method 400, according to anexample embodiment, to communicate a transmission 297 that facilitatesmodification of playback of primary content 32 at a receiving device 12.Illustrated on the far right are operations performed by theadvertisement server 304. Illustrated on the center right are operationsperformed by the entertainment server 296. Illustrated on the centerleft are operations performed by the insertion server 308. Illustratedon the far left are operations performed by the receiving device 12.Illustrated in the center are operations performed by the live feed 302.

The method 400 commences at operation 401 with the live feed 302communicating a component transmission 291 to the insertion server 308.The component transmission 291 may include primary content 32 includingentertainment assets 44 (e.g., movie, serial episode, documentary, etc.)and advertisement assets 46 (e.g., advertisement, public serviceannouncement, infomercial, etc.). Further, the component transmission291 may include secondary information 34 including a secondaryinformation table 350. The secondary information table 350 may includesa secondary information identifier 352 that may be utilized to associatethe primary content 32 to secondary content 35 or secondary information34 that may be utilized to generate the secondary content 35.

At operation 402, the transport module 310 at the insertion server 308may receive the component transmission 291 from the live feed 302.

At operation 403 the entertainment server 296 communicates a componenttransmission 293 to the insertion server 308. The component transmission293 may include primary content 32 including entertainment assets 44(e.g., movie, serial episode, documentary, etc.) and secondaryinformation 34 including a secondary information table 350. Thesecondary information table 350 may includes a secondary informationidentifier 352 that may be utilized to associate the primary content 32to secondary content 35 or secondary information 34 that may be utilizedto generate the secondary content 35.

At operation 404, the transport module 310 at the insertion server 308may receive the component transmission 293 from the entertainment server296.

At operation 406, the advertisement server 304 communicates a componenttransmission 295 to the insertion server 308. The component transmission295 may include primary content 32 including advertisement assets 46(e.g., advertisement, public service announcement, infomercial, etc.)and secondary information 34 including a secondary information table350. The secondary information table 350 may include a secondaryinformation identifier 352 that may be utilized to associate the primarycontent 32 with secondary content 35 or secondary information 34 thatmay be utilized to generate the secondary content 35.

At operation 408, at the insertion server 308, the transport module 310may receive the component transmission 295 from the advertisement server304.

At operation 410, the transport module 310 may generate a transmission297 based on the component transmissions 293, 295 received from theentertainment server 290 and the advertisement server 304. For example,the transmission 297 may include the primary content 32 and secondaryinformation 34 from the component transmission 293 (e.g., entertainmentassets 44 and associated secondary information 34) and the primarycontent 32 and secondary information 34 from the component transmission295 (e.g., advertisement assets 46 and associated secondary information34).

At operation 412, the transmission module 312 communicates thetransmission 297 to the receiving device 12.

At operation 414, the receiving device 12 receives the transmission 297.As described above, the processing module 322 at the receiving device 12may utilize the secondary information identifier 352 in the transmission297 to associate the primary content 32 to secondary content 35. Forexample, the primary content 32 may include an entertainment asset 44that may be associated to secondary content 35 in the form of anentertainment recording 52. Another example may include primary content32 that may include an advertisement asset 46 that may be associated tosecondary content 35 in the form of an advertisement recording 54.

In general, the transmission 297 received from the insertion server 308may support the association of primary content to secondary content aspreviously described by the method 370.

FIG. 26 is a display device 26 with an image 134, according to anexample embodiment, that was rendered from an advertisement recording54. The image 134 is shown to include a progress bar 136 that provides avisual indication to the user of the amount of time remaining to fastforward the entire advertisement asset 46. Specifically, the progressbar 136 provides the visual indication of the advertisement asset 46fast forwarding at two-times the normal speed.

FIG. 27 shows a diagrammatic representation of a machine in the exampleform of a computer system 600 within which a set of instructions, forcausing the machine to perform any one or more of the methodologiesdiscussed herein, may be executed. In alternative example embodiments,the machine operates as a standalone device or may be connected (e.g.,networked) to other machines. In a networked deployment, the machine mayoperate in the capacity of a server or a client machine in server-clientnetwork environment, or as a peer machine in a peer-to-peer (ordistributed) network environment. The machine may be a server computer,a client computer, a personal computer (PC), a tablet PC, a set-top box(STB), a Personal PrimaryAssistant (PDA), a cellular telephone, a webappliance, a network router, switch or bridge, an iPod, a personal videorecorder (PVR) (e.g., analog or digital input), a personal digitalrecorder (PDR) (e.g., analog or digital input), a mobile phone, aportable media player, a game console or any machine capable ofexecuting a set of instructions (sequential or otherwise) that specifyactions to be taken by that machine. Further, while only a singlemachine is illustrated, the term “machine” shall also be taken toinclude any collection of machines that individually or jointly executea set (or multiple sets) of instructions to perform any one or more ofthe methodologies discussed herein.

The example computer system 600 includes a processor 602 (e.g., acentral processing unit (CPU) a graphics processing unit (GPU) or both),a main memory 604 and a static memory 606, which communicate with eachother via a bus 608. The computer system 600 may further include a videodisplay unit 610 (e.g., a liquid crystal display (LCD) or a cathode raytube (CRT)). The computer system 600 also includes an alphanumeric inputdevice 612 (e.g., a keyboard), a cursor control device 614 (e.g., amouse), a disk drive unit 616, a signal generation device 618 (e.g., aspeaker) and a network interface device 620.

The disk drive unit 616 includes a machine-readable medium 622 on whichis stored one or more sets of instructions (e.g., software 624)embodying any one or more of the methodologies or functions describedherein. The software 624 may also reside, completely or at leastpartially, within the main memory 604 and/or within the processor 602during execution thereof by the computer system 600, the main memory 604and the processor 602 also constituting machine-readable media.

The software 624 may further be transmitted or received over a network626 via the network interface device 620.

While the machine-readable medium 622 is shown in an example embodimentto be a single medium, the term “machine-readable medium” should betaken to include a single medium or multiple media (e.g., a centralizedor distributed database, and/or associated caches and servers) thatstore the one or more sets of instructions. The term “machine-readablemedium” shall also be taken to include any medium that is capable ofstoring, encoding or carrying a set of instructions for execution by themachine and that cause the machine to perform any one or more of themethodologies of the present disclosure. The term “machine-readablemedium” shall accordingly be taken to include, but not be limited to,solid-state memories, optical and magnetic media, and carrier wavesignal.

Thus, systems and methods to modify playback or playback have beendescribed. Although the present disclosure has been described withreference to specific example embodiments, it will be evident thatvarious modifications and changes may be made to these exampleembodiments without departing from the broader spirit and scope of thedisclosure. Accordingly, the specification and drawings are to beregarded in an illustrative rather than a restrictive sense.

The invention claimed is:
 1. A system including: a demultiplexer to receive a transmission at a receiving device, the transmission including primary content and a secondary information identifier, store the transmission on a local storage device; a processor to retrieve the transmission from the local storage device; a render module to render the primary content to an output device at the receiving device at a normal speed for the primary content; and a processing module to receive a request to render the primary content to an output device at the receiving device at an accelerated speed of the primary content, associate the primary content to secondary non-derivative content based on the secondary information identifier, the render module to render the secondary non-derivative content, instead of the primary content, to the output device at the receiving device, the secondary non-derivative content not being derived from the primary content, the render module to render responsive to receipt of the request.
 2. The system of claim 1, wherein the request includes a trick mode request and wherein the trick mode request includes any one from a group of trick mode requests including a fast forward request and a rewind request.
 3. The system of claim 1, wherein the output device includes a display device and a sound device.
 4. The system of claim 1, wherein the secondary non-derivative content includes any one from a group including an entertainment recording, an advertisement recording, an entertainment slide show, and an advertisement slide show, entertainment recording metadata, advertisement recording metadata, entertainment slide show metadata and advertisement slide show metadata.
 5. The system of claim 2, wherein the processing module generates the secondary non-derivative content with a secondary application, wherein the secondary application includes any one from a group including an entertainment application and an advertisement application.
 6. A method including: receiving a transmission at a receiving device, the transmission including primary content and a secondary information identifier; storing the transmission on a local storage device; retrieving the transmission from the local storage device; rendering the primary content to an output device at the receiving device at a normal speed for the primary content; receiving a request to render the primary content to an output device at the receiving device at an accelerated speed of the primary content; associating the primary content to secondary non-derivative content based on the secondary information identifier; and rendering the secondary non-derivative content, instead of the primary content, to the output device at the receiving device, the secondary non-derivative content not being derived from the primary content, the rendering responsive to receiving the request.
 7. The method of claim 6, wherein the request includes a trick mode request and wherein the trick mode request includes any one from a group of trick mode requests including a fast forward request and a rewind request.
 8. The method of claim 6, wherein the output device includes a display device and a sound device.
 9. The method of claim 6, wherein the secondary non-derivative content includes any one from a group including an entertainment recording, an advertisement recording, an entertainment slide show, and an advertisement slide show, entertainment recording metadata, advertisement recording metadata, entertainment slide show metadata and advertisement slide show metadata.
 10. The method of claim 6, wherein associating the primary content to the secondary non-derivative content includes generating the secondary non-derivative content with a secondary application, wherein the secondary application includes any one from a group including an entertainment application and an advertisement application.
 11. A tangible non-transitory machine readable medium storing a set of instructions that, when executed by a machine, cause the machine to: receive a transmission at a receiving device, the transmission including primary content and a secondary information identifier; store the transmission on a local storage device; retrieve the transmission from the local storage device; render the primary content to an output device at the receiving device at a normal speed for the primary content; receive a request to render the primary content to an output device at the receiving device at an accelerated speed of the primary content; associate the primary content to secondary non-derivative content based on the secondary information identifier; and render the secondary non-derivative content, instead of the primary content, to the output device at the receiving device, the secondary non-derivative content not being derived from the primary content, the rendering responsive to receiving the request.
 12. A system including: a demultiplexer to receive a transmission at a receiving device, the transmission including primary content and a secondary information identifier, store the transmission on a local storage device; a processor to retrieve the transmission from the local storage device; a render module to render the primary content to an output device at the receiving device at a normal speed for the primary content; and a first means for receiving a request to render the primary content to an output device at the receiving device at an accelerated speed of the primary content, associating the primary content to secondary non-derivative content based on the secondary information identifier, the render module to render the secondary non-derivative content, instead of the primary content, to the output device at the receiving device, the secondary non-derivative content not being derived from the primary content, the render module to render responsive to receipt of the request. 